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The  "first  nonpar ame trie  saxisus  psnalized  likelihood  density 
estimator  of  Good  end  Gaskins" ,  corresponding  to  a  penalty  propor¬ 
tional  to  the  Fisher  information,  is  derived  in  the  case  that  the 
density  function  has  its  support  on  the  half-line.  The  computa¬ 
tional  feasibility  as  veil  as  the  consistency  properties  of  the 
estimator  are  indicated. 
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A  NOTE  ON  A  NONPARAMETRIC  MAXIMUM  PENALIZED 
LIKELIHOOD  ESTIMATOR  OF  THE  PROBABILITY 
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Let  X_,X_,...,X  b«  independent  otoservatione  from  a  distri- 
i  <  n 

but ion  function  t  with  density  function  f  assumed  to  have  finite 
Plsher  information  Ilf)  5  / (f')2/f  -  4 /(.v1)2,  where  v  =  f*.  The 
maximum  penalized  likelihood  method  of  density  estimation  (M PLE) 
was  introduced  by  Good  and  Gaskins  119711  and  consists  of  maximizing 
the  penalised  likelihood  functional  L(f 1  £  fCX^)  exp{-$(f)), 
where  ♦  denotes  sosm  penalty  functional  for  "rough"  density 
functions  f.  Thus,  they  avoided  the  Dirac  delta  solution  of  the 
unpenalised  problem,  and  for  the  two  penalty  functionals  they 
proposed  they  were  led  to  two  nonpar ame trie  density  estimators, 
known  as  the  "first  and  second  MPLS’s  of  Good  and  Gaskins"  after 
de  Montrichar,  Tapia  and  Thompson's  (.1975)  paper  where  their 
existence  and  uniqueness  were  rigorously  established  within  the 
framework  of  Sobolev  spaces. 

The  "first  MFLB  of  Good  and  Gaskins"  f  ,  to  which  we  restrict 

n 

ourselves  here,  corresponds  to  #(f)  -  aX(f)/4,  a  >  0,  and  in  the 


case  that  the  support  of  f  is  the  entire  real  line  3R  and 
v  6  CR)  5  {vs  v,  v'  €  Lj  (R) }  -  a  Sobolev  space  of  order  one  - 


de  Montricher  et  al  (1975)  showed  fR  to  be  an  exponential  spline 

2 

with  knots  at  the  sample  points,  given  by  f  •  u  ,  where 


(1)  «n<x>  -  <4Xn0)"^  l  exp{- ft n/a  ) **  jx-xj),  x  €», 


is  the  NP1E  of  v,  with  X  >  0  -  the  Lagrange  multiplier  corresponding 

n 

to  the  constraint  ft  ■  1  of  the  underlying  optimisation  problem. 


-2- 


We  will  show  that  in  the  caae  that  f  hae  its  support  on  the 
half  line  £  (0,  oil  and  v  €  H^flR+) ,  the  "first  MPLE  of  Good  and 

Gaskins”  f+  (we  supress  the  subscript  n)  is  also  an  exponential 
spline  with  knots  at  the  sample  points ,  given  by  f+  »  u+,  where 
u+  -  the  MPLE  of  v  -  is  given  by  12)  below. 

Let  II  *  |(j»  II  *  II  +  danot®  the  L^flR)  and  I<2  CR+1  norms 
respectively,  and  consider  the  MPLE  problem 


IPli  max  u2 Ui)exp{-a  llu'  u  € 

subject  to:  ||u||2  +  “  1  and  ulX^  >  0,  i  ■  1,2,. ..,n. 
Proposition  1.  Problem  (Pll  has  a  unique  solution  u+,  given 
illicitly  by 

12)  u  lx)  -  14X  a )  l  u  lx4)"1Iexp{-a/a)1*  |x-X  |  + 

i-1  ♦  1  1 

exp {-IX/  aj^x+xj}),  x  €*+, 

where  X  >  0  is  the  Lagrange  multiplier  corresponding  to  the  con¬ 
straint  IMI2f+  -  1. 

Proof.  Let  u(x)  £  ul|x|)  for  all  x  € JR  (o),  ulO)  £  lia  ulx), 

x-*0+ 

and  set  X_^  £  for  all  n.  Then  problem  (PI)  is  equivalent 


to  problc 


CP2)  max  u2^)  axp{- o  J|u’ ||2>,  u  6 

subject  to:  ||u||2  -  2  and  u(X^)  £  0,  |i|  -  l,...,n. 


-3- 


where  =  {g  €  H1®);  g(x)  ■  g(-x)  for  all  x  6*}.  Notice  that 
for  u  €  H1©),  i.e.,  for  u  not  necessarily  symmetric,  there  exists 
a  unique  solution  to  problem  IP2)  given  by 

u  lx)  •  UX  a)  l  u.lX.l'1  exp  -(X/a)*1  |x-x.  |},  x  €  JR. 

|i|-l°  1  1 


where  X  is  the  Lagrange  multiplier  corresponding  to  the  constraint 
||u|)  j  “  2.  The  arguments  leading  to  this  result  are  identical  to 
those  in  de  Montricher  et  al  (1975)  leading  to  (JL) .  Hence  to  show 
that  the  spline  function  uQ  is  also  the  unique  solution  to  problem 
IP2)  and  hence  u+(x)  =  ulx)  for  x  €»+,  the  unique  solution  to 
problem  (PI),  we  need  only  prove  that  u  is  in  H  -  i.e.,  symmetric 
about  sero.  To  this  end  notice  that  uQ  is  snanetric  everywhere  if 
it  is  symmetric  at  the  knots,  i.e.,  if  ulX^)  ■  ul-X^  for  i-l,...,n. 
But  this  is  true  since  in  system  (3)  below  the  variables  ulX^), 
ul-X^l ,  i*l, . . . ,n  are  interchangeable; 

13)  ulx  )  -  14X  a)  ~l*  X  (ulx.)'1  exp{-(X/ a)H  |x.-x.  j)  + 

3  i«*l  1  3 

u(-Xi)'1  exp{-(V  o)*’  Ix^+xJ}), 

ul-x.)  -  (4  X  a)'*  X  (ulX  j'1  exp{-(  A/o$  **  |x.+X.  | }  + 

3  i-1  1  31 

ul-Xi)"1  exp{-( Va)1*  jx.-xj}), 


j*l , . . . , n. 

Corollary  1.  The  "first  MPLE  of  Good  and  Gaskins"  when  f  has  its 

2 

support  on is  given  by  f+  ■  u+. 


Proof,  This  is  a  consequence  of  the  nonnegativity  of  ti+  and 
Leans  3.1  in  de  Montricher  et  al  (1975). 

Remark  1.  All  the  consistency  results  developed  in  Klonias  (1931) 
2 

for  f  ■  u  ,  where  u  is  given  by  11),  are  also  valid  for  f  and 
n  n  n  + 

very  little  has  to  be  changed  in  the  way  of  proofs. 

Remark  2.  Equation  (2)  gives  u+  only  implicitly  and  the  values  of 

the  estimate  at  the  sample  points  have  to  be  determined ,  i . e . , 

system  (3)  has  to  be  solved  and  \  to  be  chosen  so  that  ||u||2  -  2. 

In  Chapter  4  of  Klonias  (1980) ,  utilizing  the  particular  structure 

of  the  "first  MPLE  of  Good  and  Gaskins",  an  efficient  method  is 

presented  for  the  resolution  of  the  spline  f  ,  which  can  be  easily 

n 

adapted  to  determine  the  values  of  f+  at  the  knots.  The  reader  is 
also  referred  to  Good  and  Gaskins  (1971,  1980) ,  Scott,  Tapia  and 
Thompson  (1976) ,  Tapia  and  Thompson  (1978) ,  and  Ghorai  and  Rubin 
(1979) ,  where  methods  for  the  numerical  evaluation  of  f  are 


presented 
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